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Method and System for Measuring 
Data Quality of Service in a Wireless Network using 
Multiple Remote Units and a Back End Processor 

5 Background of the Invention 

1. Field of the Invention. 

The present invention relates generally to a method and system for measuring 
quality of service in a wireless network. 

10 The present invention relates specifically to a method and system for measuring 
quality of service in a wireless network using multiple remote units and a back 
end processor. 

2. Description of the Related Art. 

15 

There are two major technical fields that have shown explosive growth over the 
past few years: the first is wireless communications and the second is use of data 
services, particularly the Internet These two technical fields both require a set of 
specialized tools in order to measure their quality of service. Interestingly, 
20 wireless communications and data services are beginning to converge. 

Unfortunately, this convergence has not been accompanied by the development 
of appropriate specialized tools to measure data quality of service in the wireless 
network. 

25 The growth of wireless communications has been astounding. Twenty years ago, 
there was virtually no use of wireless communications devices such as cellular 
phones. In contrast, the market penetration for wireless devices in the U.S. in 
1999 was 32 percent. The current forecast is that 80 percent of the U.S. 
population will be wireless subscribers by 2008. 

30 

There are a variety of specialized tools that are used to measure quality of 
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service over wireless networks. These include the following (just to name a few 
examples): 

Ascom QVoice (including QVoice unattended); 
Ericsson TEMS, RSAT-2000, Benchmarker, CellAD, and CeNA; 
5 Nokia TOM; 

Safco VoicePrint, DataPrint, and WalkAbout; 
Comarco BaseLINE and Gen II; 
Grayson Surveyor; 
ZK CellTest DX1 36 and DXC; 
10 Ameritec Swarm; 

Neopoint Datalogger; and 

Qualcomm QCTest Retriever and QCTest CAIT. 

The general deficiency with these tools is that they were primarily developed to 
15 measure voice quality and/or RF parameters over the wireless system and not to 
measure data quality. Some of them have been modified to include some 
rudimentary data measurements; however, they are not optimized for performing 
wireless data measurements. In particular, they do not allow unattended 
measurement of wireless data from multiple remote units in a statistically 
20 significant manner with remote control from a back end processor. 

The classical way of measuring voice quality of service and/or RF parameters in 
a wireless network involves sending out technicians to drive test the network. 
The drive test includes placing the test instrument in a vehicle and running a test 
25 script that either generates or receives a voice test signal. The receiving end of 
the communication link uses a DSP containing a model of human hearing to 
analyze the received voice sample and produce an associated quality score. In 
addition, some of the systems measure other system parameters such as SINAD, 
noise, distortion, received signal level, and call progress statistics. 

30 

Unfortunately, the classical method of measuring voice quality of service and/or 
RF parameters does not function very well for measuring data quality of service. 
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In order to make statistically significant measurements of data quality of service 
over a wireless network, it is necessary to make multiple measurements from 
multiple remote devices. Furthermore, a measurement of data quality is 
inherently different from the other types of measurements due to the effects of ' 
5 latency and other effects that are specific to data. 

Most of the existing measurement devices do not have this capability for a variety 
of reasons. The price of the test instruments range anywhere from $5K to 
$100K. This makes it price prohibitive to field a statistically significant fleet of 

10 remote devices. Thus, what is needed are remote devices designed for 

unattended operation that is remotely controlled by a back end processor in order 
to reduce manpower costs. Additionally, what is needed are remote devices that 
are optimized for performing measurements that are useful over wireless data 
networks, such as latency for Web page access or delay in SMS message 

is delivery. 

■ 

The growth of data services has been just as astounding as the growth rate for 
the wireless industry. The largest driving force behind the growth of data 
services has been the enormous growth of the Internet. For example, there were 
20 130 Web sites in June 1993, 230,000 Web sites in June of 1996, and 10 million 
Web sites at the end of 1 999. 

There have been a variety of specialized tools developed to measure the data 
quality of service over the Internet. 

25 

U.S. Patent No. 6,006,260 to Barrick, Jr. et al. (assigned to Keynote Systems, 
Inc) discloses a method for gathering latency experienced by a user over a 
network. The steps of the method include a user browser sending a GET 
command to retrieve an HTML page with an embedded Java script. The Java 
30 script starts a timer and generates a GET command to retrieve an HTML page. 
.When the page is received, the timer is stopped and the timer information along 
with cookie data stored on the browser machine is sent to a relay server that logs 


WO 01/72058 


PCT/US01/08999 


the information. 

U.S. patent No. 5, 657,450 to Rao et al. teaches the provision of time estimates 
for long-running distal source access operations using an intermediate server 
5 close to the client workspace. 

U.S. patent No. 5, 796, 952 to Owen et al. discloses a method for monitoring a 
user's time of page browsing. 

10 U.S. patent No. 6, 012,096 to Link et al. teaches a method for monitoring client- 
to-client network latency for gaming applications. The method involves a ping, 
response, and response-response protocol. 

Unfortunately, none of these patents teach a method which is appropriate for 
is performing data quality of service measurements over a wireless network. 

As previously mentioned, there is a tremendous convergence taking place that 
combines the wireless network with data services. Dataquest estimates that the 
U. S. wireless data market (including phones, PDAs, laptops, and the like.) will 
20 grow from 3 million subscribers in 1999 to 36 million subscribers in 2003. 
Ericsson is estimating that 1 billion wireless units will be in use worldwide by 
2003 and that 40 percent (400 million) of these units will be employed by data 
users. Furthermore, Ericsson is predicting that 2003 will be the crossover year in 
which wireless Web access will exceed wired Web access. 

25 

As a further measure of the explosive growth of the convergence of the wireless 
systems and the Internet, one can look at projections for the number of wireless 
portal subscribers. According to the Strategis Group, the number of wireless 
portals will increase from 300,000 in 2000, to 9.8 million in 2003, and finally to 
30 24.8 million in 2006. 

A variety of technical advancements have accelerated the convergence of 
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Internet access over wireless devices. In 1997, three competing handset 
vendors (Nokia, Ericsson, and Motorola) and a small software company 
(Phone.com, formerly Unwired Planet) joined forces to create a standard way to 
transmit Internet data to wireless phones without occupying too much bandwidth. 
5 The result of this collaboration was development of the wireless application 
protocol (WAP). One basic component of WAP was development of the WML 
(Wireless Markup Language, replacing the previous Phone.com Handheld Device 
Markup Language, HDML) that compresses Web content in comparison to 
HTML. Additionally, the WAP forum developed standards for the use of 
10 microbrowsers in mobile devices. 

Unfortunately, the development of wireless Web access technology has 
significantly outpaced the development of wireless data measurements tools. 
Accordingly, there is a tremendous need for specific test tools to address the 
is converging technologies of wireless systems and data communications. 

Summary of the Invention 

In order to meet this need, a measuring tool is provided for measuring data 
20 quality of service over the wireless network. This tool was designed from the 
ground up with a variety of specific attributes. 

The present invention provides for a method and system for measuring data 
quality of service in a wireless network using multiple peripatetic (i.e. mobile) 

25 and/or stationary, unattended, position and performance instruments (PUPPIs) 
that are remotely controlled by a back end processor. According to some 
embodiments of the invention, the data service whose quality is measured relates 
to wireless Internet access, e-commerce transactions, wireless messaging, or 
push technologies. According to other embodiments of the invention, the system 

30 includes an element that is located within the wireless network infrastructure, for 
example, at the WAP gateway to monitor the wireless data protocol and to 
perform benchmarking measurements. 
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The remote unit is able to provide an appropriate statistical distribution for data 
measurements. The remote units can be peripatetic (i.e. mobile) so that they are 
able to roam over a statistically significant geographical area, or stationary with 
5 pre-planned location at statistically significant points, or some combination of 
mobile and stationary. 

Furthermore, the system includes multiple remote units that are unattended and 
are remotely controlled by a back end processor. This allows for a large quantity 
10 of measurements to be taken in a fully automated manner. 

Additionally, each of the remote units provides position information for each 
measurement as well as performance information that is related to wireless data. 
More specifically, the performance information may be related to wireless Internet 
15 access, e-commerce transactions, or wireless messaging using either push or 
pull technologies. 

For example, one of the most critical measurements for the wireless Internet user 
is a measurement of the latency, i.e. the amount of time it takes to receive a 
20 response after a GET command is sent. In the case of wireless messaging, the 
latency measurement includes the amount of time required to receive information 
after it is sent from the source. 

In addition, it is useful to perform measurements which divide the network into a 
25 wireless and wired portion and that provide separate measurements for each 
portion. Accordingly, the system may include an element that is located within 
the wireless network infrastructure, for example at the WAP gateway, to monitor 
the wireless data protocol and to perform benchmarking measurements. 

30 Accordingly, an object of the present invention is to provide a method and system 
for measuring data quality of service in a wireless network using multiple remote 
units and a back end processor. 
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A further object of the invention is to perform these measurements on a variety of 
different types of traffic wireless networks, such as iDEN, CDMA, TDMA, and 
GSM, for example. 

5 

Another objective of the invention is to perform these measurements during a 
variety of different types of communications such as circuit switched calls, packet 
data calls, SMS messages, wireless internet access, wireless internet 
transactions (including e-commerce), and during the reception of push data (i.e. 
10 data which is delivered using push technology). 

A further objective of the invention is to collect a variety of different types of 
measurements such as latency measurements, reliability (e.g. BER/FER), layer 3 
network information, RF information, call connection information, and the like. 

15 

Another objective of the invention is to use control links that are either wired or 
wireless. 

A further objective of the invention is to use remote units that are either mobile, 
20 stationary, or some combination of mobile and stationary so that they provide 
statistically significant measurements. 

Another object of the invention is to provide a back end which allows user access 
through the Internet, allows for post-processing of the received data, allows for 
25 scheduling collection missions based on available resources, and allows for 
generation of test traffic. 

An additional object of the invention is to provide a remote unit that allows for 
storage and pre-processing of the measured data, battery backup, and an RF 
30 scanner. 

Advantages of the current invention include the ability to collect statistically 
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significant data in an extremely cost effective and easy to use manner. 

Brief Description of the Drawings 

5 FIGS. 1a-g show a generic communication network with a variety of wireless 
communication paths connected to the Internet 

FIG. 1a shows the communication path for the traffic data in a standard wired 
Internet measurement system. 

FIG. 1b shows the communication path for the traffic data during a circuit 
10 switched data connection in accordance with an embodiment of the invention. 

FIG. 1c shows the communication path for the traffic data during a packet 

switched data connection in accordance with an embodiment of the invention. 

FIG. 1d shows the communication path for the traffic data during an SMS 

message transmission in accordance with an embodiment pf the invention. 
15 FIG. 1e shows the communication path for the traffic data during a WAP data 

connection in accordance with an embodiment of the invention. 

FIG. 1f shows the communication path for the traffic data during a WAP data 

connection in accordance with a further embodiment of the invention. 

FIG. 1g shows the communication path for the traffic data during a WAP data 
20 connection, including a WAP monitoring processor, in accordance with a further 

embodiment of the invention. 

FIG. 1h shows the communication path for the control link in accordance with an 
embodiment of the invention. 

25 FIG. 2a shows the system architecture in accordance with one embodiment of 
the invention. 

FIG. 2b shows the system architecture in accordance with a further embodiment 
of the invention. 

FIG. 2c shows the system architecture in accordance with another embodiment 
30 of the invention. 

FIG. 2d shows the system architecture in accordance with a further embodiment 
of the invention. 
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FIG. 2e shows the system architecture in accordance with another embodiment 
of the invention. 

FIGS. 3a through 3d show a variety of basic architectures for remote units 
5 according to various embodiments of the invention. 

FIG. 3a shows the basic architecture for the remote unit in accordance with one 
embodiment of the invention. 

FIG. 3b shows another architecture for the remote unit with separate control link 
modem and traffic modem according to an alternate embodiment of the invention. 
10 FIG. 3c shows another architecture for the remote unit with separate control link 
modem and multiple traffic modems according to another alternate embodiment 
of the invention. 

FIG. 3d shows a further architecture for the remote units that include multiple 
peripherals in accordance with one embodiment of the invention. 

15 

FIGS. 4a through 4d show a variety of alternate implementations for the remote 
unit in accordance with one embodiment of the invention. 
FIG. 4a ^hows a hardware implementation of the remote unit using either a 
laptop or handheld unit in accordance with one embodiment of the invention. 
20 FIG. 4b shows a hardware implementation of the remote units using a single 
board computer (SBC) in accordance with one embodiment of the invention. 
FIG. 4c shows the organization of the software-defined radio in accordance with 
an embodiment of the invention. 

FIG. 4d shows the organization of the software in the remote unit in accordance 
25 with an embodiment of the invention. 

FIG. 5a shows the architecture of the back end processor in accordance with one 
embodiment of the invention. 

FIG. 5b shows the architecture of the back end processor in accordance with an 
30 alternate embodiment of the invention. 

FIG. 5c shows the architecture for the portal in accordance with one embodiment 
of the invention. 
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FIG. 6a shows examples of some of the fields in the remote unit originated 
packets (both data and signaling) in accordance with one embodiment of the 
invention. 

5 FIG. 6b shows examples of some of the fields in the back end processor 

originated packets (both data and signaling) in accordance with one embodiment 
of the invention. 

FIG. 7a shows a method for measuring data quality of service in a wireless 
10 network in accordance with one embodiment of the invention. 

FIG. 7b shows a method for measuring data quality of service in a wireless 
network, including at least one step related to the wireless network infrastructure, 
in accordance with an alternate embodiment of the invention. 
FIG. 7c shows a method for measuring data quality of service in a wireless 
15 network, including at least one additional order independent step, in accordance 
with another embodiment of the invention. 

FIG. 8a shows a bar graph output of download times from different portals in 

accordance with an embodiment of the invention. 
20 FIG. 8b shows a bar graph output of download times across different wireless 

networks in accordance with an embodiment of the invention. 

FIG. 8c shows a bar graph output of call completion percentage across different 

wireless networks in accordance with an embodiment of the invention. 

FIG. 8d shows a trending graph output of call completion percentage across 
25 different wireless networks in accordance with an embodiment of the invention. 

FIG. 8e shows a bar graph output of average download times with a breakdown 

of the network latency at the WAP gateway in accordance with an embodiment of 

the invention. 

FIG. 8f shows a pie chart of error statistics for wireless access of Yahoo in 
30 accordance with an embodiment of the invention. 
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Detailed Description of the Invention 

OVERVIEW 

In order to understand the present invention, it is helpful to compare the 
communication path of current data measurements tools with the communication 

5 path in accordance with several embodiments of the invention. FIGS. 1a-g show 
a generic communication network with a variety of wireless communication paths 
connected to the Internet. It is well known to those of ordinary skill in the art that 
these figures illustrate a generic network that is used for illustrative purposes. 
For example, in some cellular networks there is a base station controller 

10 connected to multiple base stations between their connections to the MSC. As 
another example, the WAP gateway, packet data gateway, and PSTN connection 
may be replaced in some wireless networks by a single device that is directly 
connected to the MSC. 

is FIG. 1a shows the communication path (heavy broken line) for the traffic data in a 
standard wired Internet measurement system. The traffic data flows between the 
user machine 124 over the Internet 122 to a standard application server 126 that 
will generally be serving an HTML page. 

20 FIG. 1b shows the communication path (heavy broken line) for the traffic data 
during a circuit switched data connection in accordance with an embodiment of 
the invention. The traffic data passes from the remote unit 102-1 to the base 
station 106, MSC 108, PSTN 110, ISP 112, Internet 122, and to a standard 
application server 126. The standard application server 126 may be serving an 

25 HTML page, for example. 

FIG. 1c shows the communication path (heavy broken line) for the traffic data 
during a packet switched data connection in accordance with an embodiment of 
the invention. The traffic data passes from the remote unit 102-1 to the base 
30 station 106, MSC 108, operator backbone 114, packet data gateway 118, Internet 
122, and standard application server 126. For example, the standard application 
server 126 may be serving an HTML page. 
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FIG. 1d shows the communication path (heavy broken line) for the traffic data 
during an SMS message transmission in accordance with an embodiment of the 
invention. If the SMS message is being delivered to the remote unit 102-1, the 
5 traffic data passes from a standard application server 126 to the Internet 122, 
SMSC 116, operator backbone 114, MSC 108, base station 106, and remote unit 
102-1. 

FIG. 1e shows the communication path (heavy broken line) for the traffic data 
10 during a WAP data connection in accordance with an embodiment of the 

invention. If the remote unit 102-1 is accessing a WAP server 128, the traffic 
data passes from the remote unit 102-1 to a base station 106, MSC 108, operator 
backbone 114, WAP gateway 120, Internet 122, and WAP server 128. For 
example, the traffic data path shown in FIG. 1e allows for latency measurements 
is for wireless Web page access or e-commerce transactions. 

It is important to note that the term WAP is being used genetically to refer to any 
wireless Internet protocol, including HDML and any future wireless Internet 
protocols that may be developed. The following examples are provided of some 

20 competing technologies that for the purposes of this patent will be referred to 
generically as WAP. For example, the Web content can be delivered as text 
messaging or as an SMS message (as proposed by Xypoint or GoSMS) so that it 
is compatible with existing cellular phones. Alternatively, the Web content can be 
delivered as existing HTML Internet content for wireless devices as proposed by 

25 Spyglass' Prism technology or Japan's iMode. As a further example, the content 
can be processed through a template model that reads existing HTML content 
and fits the data to a template optimized for various types of wireless phones 
such as the system proposed by Everypath.com. As another example, the data 
content can be delivered to a Palm Pilot or other PDA or handheld device that 

30 uses a proprietary protocol. 

FIG. 1f shows the communication path (heavy broken line) for the traffic data 
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during a WAP data connection in accordance with a further embodiment of the 
invention. If the remote unit 102-1 is accessing the benchmark WAP server 130, 
the traffic data passes from the remote units 102-1 to a base station 106, MSC 
108, operator backbone 114, WAP gateway 120, and to the benchmark WAP 
5 server 130. This configuration allows latency measurements without including 
the uncertainties of the latency through the Internet 122 itself. In other words, the 
configuration in FIG. 1f allows measurements of the latency due to the wireless 
network itself with no contribution from the Internet 122. 

10 FIG. 1g shows the communication path (heavy broken line) for the traffic data 
during a WAP data connection, including a WAP monitoring processor 132, in 
accordance with a further embodiment of the invention. The WAP monitoring 
processor 132 may be implemented as monitoring software installed and running 
on the WAP Gateway 120 or as software installed on a separate machine 

15 attached to the WAP Gateway 120. The software would monitor traffic through 
the WAP Gateway 120 and provide metrics such as throughput, latency and lost 
packet information. This configuration would allow the wireless network and the 
Internet 122 itself to be analyzed and monitored separately, thus providing 
performance information for each. Furthermore, the WAP Monitoring Processor 

20 132 would be able to collect protocol information directly from the WAP Gateway 
120 that may not be available to the multiple remote units (102-1 through 102-N). 

The monitoring software may run as a separate application on the WAP Gateway 
120, or may be embedded into the WAP Gateway software itself and run as part 
25 of the entire gateway application. The monitoring software would have a 

mechanism for collecting metrics and passing that information to the back end 
processor through the internet, wireless network, or through some other means. 
The monitoring software may temporarily store results locally, and perform some 
pre-processing on the data prior to forwarding it to the back end processor. 

30 

FIG. 1h shows the communication path for the control link in accordance with an 
embodiment of the invention. The control link is used to remotely control the 
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remote units 140, 142, 144, 146 from the back end processor 148. Specifically, 
the process in the back end processor 148 that communicates with the remote 
units 140, 142, 144, 146 is the fleet management process, which will be 
discussed in detail later. 

5 

The remote units can be either mobile 140, 142, 144 or stationary 146, The 
mobile units 140, 142, 144 can be mounted in a variety of vehicles such as taxis, 
police cars, buses, postal vehicles, delivery vehicles, fleet vehicles, just to give a 
few examples. The stationary remote units 146 can be mounted in any area in 
10 which the public congregates and uses wireless devices. This includes airports, 
bus stations, and train stations just to provide a few examples. 

A variety of communication technologies are available to implement the control 
link. The control link can be implemented as data running over any of the current 
15 wireless networks such as CDMA, iDEN, TDMA, or GSM just to name a few 
examples. Additionally, the control link can be implemented over the AMPS 
network using CDPD for example. Alternatively, the control link can be 
implemented using a two-way data system such as ARDIS, MOBITEX, SKYTEL, 
and the like. 

20 

SYSTEM ARCHITECTURE 

FIG. 2a shows the system architecture in accordance with one embodiment of 
the invention. As previously described, the invention comprises multiple remote 

25 units (202-1 - 202-N) that may be either mobile or stationary. Each remote unit 
may include a location unit (202a-1 - 202a-N) that allows the remote unit to 
accurately determine its location. Furthermore, each remote unit includes a 
communications link (202b-1 - 202b-N) that provides for both the control link and 
the traffic data. The communications link 202b-1 communicates over a 

30 communication network 210 that passes the information to a communication 
server 212 that connects to a data network 220. The data network 220 can be a 
public data network, such as the Internet, or a private data network. A back end 
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processor 224 is connected to the data network 220 for handling control link 
information, both commands and responses, and traffic data. In addition, the 
customers 222 are also connected to the data network so that they can access 
the back end processor 224. 

5 

FIG. 2b shows the system architecture in accordance with a further embodiment 
of the invention. The system in FIG. 2b differs from the system shown in FIG. 2a 
in that the control link network and the traffic data network are two separate 
communication networks. Each remote unit (e.g., 202-1) may include a location 

10 unit 202a-1 that allows the remote unit 202-1 to accurately determine its location. 
Furthermore, each remote unit 202-1 includes a control link communication 
module 202c-1 and a traffic data communication module 202d-1. The control link 
202c-1 passes commands and response information through communication 
network A 21 OA and communication server A 212A to the data network 220. The 

15 traffic data communication module 202d-1 passes traffic data through 

communication network B (21 0B) and communications server B (21 2B) to the 
data network 220. A back end processor 224 is connected to the data network 
220 for handling control link information, both commands and responses, and 
traffic data. In addition, the customers 222 are also connected to the data 

20 network 220 so that they can access the back end processor 224. 

FIG. 2c shows the system architecture in accordance with another embodiment 
of the invention. The system shown in FIG. 2c differs from the system shown in 
FIG. 2b in that each remote unit (e.g., 202-1) may have multiple traffic modules 

25 (202d1-1 - 202dN-1). Each remote unit 202-1 may include a location unit 202a-1 
that allows the remote unit to accurately determine its location. Additionally, each 
remote unit 202-1 includes a control link communication module 202c-1 and 
includes multiple traffic data communication modules (202d1-1 - 202dN-1). The 
control link passes command and response information through communication 

30 network A 210A and communication server A 212A to the data network 220. 
Each traffic data communication module 1 through N (202d1-1 - 202dN-1) 
passes traffic data through communication network B-1 <210B-1) through B-N 
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(210B-N), respectively, and through communication servers B-1 (212B-1) 
through B-N (212B-N), respectively, to the data network 220. A back end 
processor 224 is connected to be data network 220 for handling control link 
information, both commands and responses, and traffic data. In addition, the 
5 customers 222 are also connected to the data network 220 so that they can 
access the back end processor 224. 

FIG. 2d shows the system architecture in accordance with a further embodiment 
of the invention. The system in FIG. 2d differs from the system shown in FIG. 2c 
10 in that multiple control link communication networks may be used. This is 
particularly important in systems in which the remote units are deployed in 
different cities. It may be preferable in this case to use a different control link 
communication network in different cities depending on the wireless system 
coverage and the data pricing structure. 

15 

Each remote unit (202-1 - 202-N) may include a location unit (202a-1 - 202a-N) 
that allows the remote unit to accurately determine its location. Furthermore, 
each remote unit (202-1 - 202-N) includes a control link communication module 
(202c-1 - 202c-N) and includes multiple traffic data communication modules 

20 (202d1-1 - 202dN-1 - 202d1-N - 202dN-N). The control link passes commands 
and response information through one of communication network A-1 (210A-1) 
through A-N (210A-N) depending on the appropriate communication network for 
the specific remote unit. Each control link communication network A-1 (210A-1) 
through A-N (210A-N) is connected to a respective communication server A-1 

25 (212A-1) through A-N (212A-N) which allows command and response 

information to be passed to the data network. Each traffic data communication 
module 1 (202d1-1) through N (202d1-N) passes traffic data through 
communication network B-1 (210B-1) through B-N (210B-N), respectively, and 
through communication servers B-1 (212B-1) through B-N (212B-N), 

30 respectively, to the data network. A back end processor 224 is connected to the 
data network 220 for handling control link information, both commands and 
responses, and traffic data. In addition, the customers 222 are also connected to 
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the data network 220 so that they can access the back end processor 224. 

FIG. 2e shows the system architecture in accordance with another embodiment 
of the invention. The system in FIG. 2e differs from the system shown in FIG. 2d 
5 in that both mobile and stationary remote units are shown. Because the traffic 
data communication channels in FIG. 2e are the same as those in FIG. 2d, they 
have been omitted in order to simplify the diagram. The control links for the 
mobile remote units (202-1 through 202-N) are the same as those described in 
FIG. 2d. 

10 

Each stationary remote unit (202-X through 202-Y) may include a location unit 
(202a-X through 202a-Y) that allows the remote unit to accurately determine its 
location. The location unit (202a-X through 202a-Y) is generally optional in the 
stationary remote units since their location is presumably known. The stationary 

is remote units each include a control link module (202c-X through 202c-Y) which 
is connected via a respective wired line to a respective communication network 
C-1 (210C-1) through C-N (210C-IM) and associated communication server C-1 
(212C-1) through C-N (212C-N) which allows command and response 
information to be passed to the data network 220. A back end processor 224 is 

20 connected to be data network 220 for handling control link information, both 
commands and responses, and traffic data. In addition, the customers 222 are 
also connected to the data network 220 so that they can access the back end 
processor 224. 

25 Remote Unit 

The remote unit has a variety of attributes in accordance with one embodiment of 
the invention. The remote unit should preferably be portable in terms of size and 
weight so it can be deployed in a vehicle or in a stationary public area. Possible 
30 vehicles include buses, police vehicles, taxis, postal vehicles, delivery vehicles, 
and fleet vehicles just to name a few. Examples of stationary public areas 
include airports, train stations, bus stations, and any public area where large 
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numbers of people use wireless devices. 

Another attribute of the remote unit is that it is mountable either in a vehicle or in 
a public area. There are a variety of methods that can be used for mounting the 
5 remote unit For example, the remote units can be mounted to a DIN bar that is 
commonly used for industrial equipment. Alternatively, the remote units can be 
mounted using a standard bracket, tie device, fabric strap, bolts, or adhesive 
device such as Velcro, for example. 

10 A further attribute of the remote unit is that it is able to withstand a wide 

temperature range such as the industrial temperature range of -40 degrees C to + 
80 degrees C, for example. This attribute allows deployment of the remote unit in 
a wide range of geographical environments. Furthermore, it allows deployment 
of the remote unit in places such as the trunk of a vehicle in which airflow is 

is limited. 

Another attribute of the remote unit is the ability to withstand vibration. This 
attribute is important since many of the remote units may be deployed in vehicles 
and will be subjected to severe vibration. There are a variety of standard 
20 techniques that can be used to improve the vibration performance of the remote 
unit These include using frequency absorbing mounting materials and potting 
the components on the printed circuit board for added stability. 

A further attribute of the remote unit is that it meets all local standards for 
25 emissions, both radiated and conductive. For example in United States, the 
emissions from most digital devices are covered by FCC part 1 5 and emissions 
from cellular devices are covered by FCC part 22. In Europe, there generally are 
directives which cover radiated emissions, conductive emissions, and radiated 
immunity and which must be met in order to receive the CE mark. 

30 

Another attribute of the remote unit is the ability to handle the input power source. 
First, the remote unit should include some type of power regulation. This is 
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particularly important in a vehicular environment in which the power provided by 
the vehicle battery is very noisy. Additionally, the remote unit should include the 
ability to power any external modules or peripherals that are going to be attached 
to the main control unit. Furthermore, the remote units may include some form of 

5 battery backup with an automatic charger so that the remote unit in a mobile 
environment does not drain the vehicle battery when the ignition is turned off. 
This requirement is not as important in a stationary deployment since the power 
can be provided from an AC outlet using a DC transformer. However, one may 
choose to include the battery and charger in this configuration also in order to 

10 provide battery backup in the event of an AC power failure. Finally, the remote 
unit may include some form of sleep mode which is used to conserve power 
during periods of sporadic activity. 

The remote unit will now be described with regard to a variety of embodiments in 
15 accordance with the invention. FIGS. 3a through 3d show a variety of basic 

architectures for the remote unit. FIGS. 4a through 4d show a variety of possible 
implementations for the remote unit. 

FIG. 3a shows the basic architecture for the remote unit in accordance with one 
20 embodiment of the invention. The remote unit 300 comprises a control unit 302, 
a location unit 304, and a control link and traffic modem 306. The control unit 
302 is the main control device for the remote unit 300 and is connected to the 
location unit 304 and the control link and traffic modem 306. The location unit 
304 determines the location of the remote unit 300. 

25 

The control link and traffic modem 306 shown in FIG. 3a is used to communicate 
with the back end processor 224. The control link and traffic modem 306 is 
connected to the control unit 302 in order to send and receive control information 
and traffic information. The control unit is generally running a main program that 
30 controls the location unit 304 and the control link and traffic modem 306. 

There are a variety of ways in which the location unit 304 can determine the 
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location in accordance with the invention. The location unit 304 may comprise a 
GPS receiver such as those manufactured by Trimble, Ashtech, Garmin, or 
Magellan, for example. If the location unit 304 is a GPS receiver, the connection 
to the control unit 302 may be a serial communication link. In another 
5 embodiment, the location unit 304 may comprise a GPS daughterboard such as 
those manufactured by Avocet, Trimble, Ashtech, or Rockwell, for example. If 
the location unit 304 is a GPS daughterboard, the connection to the control unit 
302 is usually through a proprietary connector mounted on the control unit 302. 
. The control of the GPS daughterboard is generally accomplished using a serial 
10 connection. In a further embodiment of the invention, the location unit 304 may 
comprise a GPS chipset or a single GPS chip which is mounted directly on the 
control unit 302 and which has a bus interface. Furthermore, any of the GPS 
implementations of the location unit can include differential GPS using RTCM or 
RTCA corrections or alternatively can include WAAS capabilities. 

15 

It is well known to those of ordinary skill in the art that there are a variety of 
alternative implementations for the location unit that don't involve standard GPS. 
For example, one can use a distributed GPS system, such as the one developed 
by SnapTrack, in which part of the OPS functionality is handled by a centralized 

20 server. Another alternative location option is the use of a triangulation technique 
using either angle of arrival or time difference of arrival information. Although the 
generic term triangulation is used, there is no requirement that three 
measurement points be used. A further location option is the use of RF 
fingerprinting, such as that developed by U.S. Wireless, which determines the 

25 unit location based on a multipath signature. 

Those of ordinary skill in the art will understand that FIGS. 2a-e, 3a-d, and 4a 
show logical antennas rather than physical antennas. These logical antennas 
can be combined in virtually any combination into a single physical antenna or 
30 groups of physical antennas depending on the specific requirements. 

FIG. 3b shows another architecture for the remote unit 300 with separate control 
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link modem 308 and traffic modem 310 in accordance with a further embodiment 
of the invention. FIG. 3b differs from FIG. 3a in that the single control link and 
traffic modem 306 has been divided into a separate control link modem 308 and 
traffic modem 310. The advantage of separating the control link modem 308 
5 from the traffic modem 310 is that it allows the remote unit 300 to communicate 
control information and traffic information over different communication networks. 

» 

It is well known to those of ordinary skill in the art that there are variety of 
implementations for both the traffic modem and the control link modem that will 

10 be referred to collectively as modem units. In one embodiment of the invention, 
the modem units may comprise a handset that is connected to the control unit 
using a special serial cable. In an alternative embodiment of the invention, the 
modem units may comprise a modem module that is connected to the control unit 
using a special serial cable. In another embodiment of the invention, the modem 

15 units may comprise a PCMCIA card that is connected to the control unit using a 
PCMCIA socket. In a further embodiment of the invention, the modem units may 
comprise a custom modem that is implemented on either a separate printed 
circuit board or on the same printed circuit board as the control unit In another 
embodiment of the invention, the modem units may comprise a software-defined 

20 radio (SDR) in which most of the radio functionality is implemented in software. 
The software can be running either on a separate printed circuit board or on the 
same printed circuit board as the control unit In an alternative embodiment of 
the invention, the control link modem may comprise a 2-way data device, such as 
the RIM Blackberry or Motorola CreataLink, which interfaces to the control unit 

25 via a serial connection. 

The traffic modem 310 is selected so that it can work over a wireless network 
using a particular wireless standard. For example, the wireless network can be 
AMPS, iDEN, CDMA, TDMA, GSM, ARDIS, MOBITEX, or CDPD. It should be 
30 noted that these standards are listed as examples and are not meant to limit the 
scope of the invention. It is well known to those of ordinary skill in the art that 
other wireless network standards such as W-CDMA, PHS, i-Burst, NAMPS, 
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ETACS, WLL, UMTS, TETRA, and NMT may also be supported just to name a 
few more examples. 

The traffic modem 310 may implement more than one wireless standard. For 
5 example, QUALCOMM manufactures dual mode phones that support both CDMA 
and AMPS operation. In addition, if the traffic modem 310 is implemented using 
a software-defined radio then it is possible to implement all of the above- 
mentioned standards using a single hardware platform. 

10 The control link modem 308 is also selected so that it can work over a wireless 
network using a particular wireless standard. For example, the wireless network 
can also be AMPS, iDEN, CDMA TDMA GSM, ARDIS, MOBITEX, or CDPD. A 
primary factor in selecting a wireless standard for the control link modem is the 
pricing policy for transmitting control link information. 

15 

FIG. 3c shows another architecture for the remote unit 300 with a control link 
modem and multiple traffic modems 310-1 - 310-N in accordance with a further 
embodiment of the invention. FIG. 3c differs from FIG. 3b because it includes 
multiple traffic modems rather than a single traffic modem. The remote unit 300 
20 architecture of FIG. 3c includes a control unit 302 that is connected to a location 
unit 304, controMink modem 308, and traffic modems 1 (310-1) through N (310- 
N). 

FIG. 3d illustrates a remote unit according to one embodiment of the present 
25 invention that includes multiple peripherals. The remote unit 300 architecture of 
FIG. 3d includes a control unit 302 that is connected to a location unit 304, a 
control link modem 308, traffic modems 1 (310-1) through N (310-N), battery 
backup 312, external storage 314, a wireless LAN device 316, and an RF 
scanner 318. The location unit 304, control link modem 308, and traffic modems 
30 1 (310-1) through N (310-N) are implemented in the same manner as discussed 
above with reference to FIG. 3c. 
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The battery backup 312, shown in FIG. 3d, provides power to the remote unit 300 
when the main power is not available. If the remote unit 300 is mounted in a 
vehicle, the battery backup 312 is used when the vehicle ignition is turned off in 
order to ensure that the remote unit 300 does not drain the vehicle battery while 
5 the vehicle is parked. If the remote unit 300 is mounted in a stationary location, 
the battery backup 312 may be used to provide power if the main power is cut off 
due to a power failure in the building. In accordance with one embodiment of the 
invention, the battery backup 312 includes a battery and a battery charger. The 
battery can be made from a variety of known rechargeable technologies such as 
10 sealed lead acid, NiCad, NiMH, and Lithium for example. 

The external storage 314 provides a temporary storage capability for data that is 
not immediately sent back to the back end processor 224. There are a variety of 
reasons for storing data in the external storage 314. For example, if layer 3 
is network data is collected for the wireless network it is possible to produce 1 
Mbyte/hour/technology of data. It may be prohibitively expensive to send this 
much data back to the back end processor 224 via the control link modem 308. 
Accordingly, the data can be stored locally in the external storage 314 and be 
downloaded at a later time using an alternate path. 

20 

As another example, the collected data may be queued for transmission when 
the vehicle ignition is turned off. It may be preferable not to transmit the stored 
data until the ignition is turned back on in order to prevent unnecessary draining 
of the battery backup mechanism 312. Accordingly, the data can be stored 
25 locally in the external storage 314 and queued for transmission in at a later time 
over the control link modem 308 when the vehicle ignition is turned on. 

It is well known to those of ordinary skill in the art that the external storage 314 
can be implemented in a variety of ways. For example, the external storage is 
30 implemented as a PCMCIA Flash card that plugs into a PCMCIA socket on the 
control unit. As another example, the external storage 314 can be a SANdisk 
that is connected to the control unit via a proprietary connector. Alternatively, the 
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external storage 314 is implemented using a moving storage device such as a 
specialized hard drive, for example a PCMCIA hard drive module. However, in 
mobile environments it is preferable to implement the external storage with no 
moving parts in order to improve the reliability of the remote unit. 

5 

The wireless LAN device 316 allows high-speed data transmission over short 
distances. In accordance with an embodiment of the invention, the wireless LAN 
device 316 is implemented, for example, using Bluetooth technology. The 
wireless LAN device 316 provides an alternative path for downloading data that is 

10 stored on the external storage 314. For example, if the remote unit 300 is 
mounted in a taxi and layer 3 wireless network data is stored from an earlier 
collection operation, then the wireless LAN device 316 is free to communicate 
with a wireless LAN controller (not shown) located at the taxi dispatch center in 
order to transmit the data back to the back end processor 224. As an alternative 

is example, the wireless LAN device 316 can be used to communicate with a local 
I/O dev|ce (not shown) that can be used in a delivery truck to allow 
communications between a central dispatch and the delivery truck operator. 

The RF scanner 318 allows increased functionality for the remote unit 300 by 
20 increasing the capabilities for performing RF optimization of the wireless network. 
The RF scanner 318 allows the collection of more RF data then is traditionally 
available through the traffic modems (310-1 - 310-N). For example, the RF 
scanner 318 has a much more flexible input bandwidth since it is not forced to 
listen to a single traffic channel on the wireless network. Additionally, if the RF 
25 scanner 318 is optimized for CDMA collection, it can collect a variety of valuable 
CDMA network parameters such as measuring lo in the channel, despreading the 
spreading codes, measuring Ec/lo, and measuring chip delay. The RF scanner 
318 can be implemented by using a commercial scanner or by developing a 
custom scanner, for example, using a software-defined radio. 

30 

FIG. 4a shows a hardware implementation of the remote unit 400 using either a 
laptop or handheld unit 402 in accordance with one embodiment of the invention. 
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The laptop or handheld unit 402 is connected to a GPS receiver 404, control link 
modem 408, and traffic modem 410. The laptop or handheld unit runs any of a 
variety of operating systems such as Windows 95/NT/CE, Linux, or Palm OS; for 
example. The peripheral devices 404, 408, 410 are connected to the laptop or 
5 handheld unit 402 via serial ports, PCMCIA ports, Ethernet, or USB as 

appropriate. The laptop or handheld unit 402 should have device drivers for all of 
the peripheral devices that are either built into the operating system or written in a 
higher-level language. Furthermore, the laptop or handheld unit 402 runs a main 
program that allows extraction of the location information from the GPS receiver 
10 404 and sends and receives communication over the control and traffic channels. 

FIG. 4b shows a hardware implementation of the remote units using a single 
board computer (SBC) in accordance with one embodiment of the invention. The 
single board computer can be purchased off-the-shelf from a variety of vendors 

15 such has SBS, ADS, or Datalogic for example. Alternatively, the single board 
computer can be custom designed for the specific remote unit application. FIG. 
4b shows a typical architecture for the single board computer including a 
microprocessor 420 which is connected via an address and data bus to a boot 
ROM 424, Flash memory 426, DRAM/SRAM 428, a PCMCIA socket 430, a 

20 UART 432, a USB interface 434, an Ethernet interface 436, a CAN interface 438, 
a wireless LAN device 440, and an optional A/D & D/A interface 442. The 
microprocessor 420 may also have direct connections to a temperature sensor 
444, display interface 446, and general-purpose I/O. Additionally, the single 
board computer may include power management circuitry 448 that is connected 

25 to switched power, power, and ground, and additionally connected to an optional 
backup battery 450. 

It is well known to those of ordinary skill in the art that the single board computer 
can be implemented using a variety of different technologies. For example, the 
30 microprocessor can be a StrongARM, ARM, Pentium, PowerPC, Motorola 68000, 
and the like. Furthermore, a variety of operating systems are available such as 
Windows CE, Windows 95/98, Windows NT, Linux,. Palm OS, VXWorks, OS-9, 
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PSOS, and the like. The serial ports from the UART 432, or directly from the 
microprocessor 420, are used to interface to peripheral devices such has the 
traffic modem 410 or the GPS receiver 404 and should have configurable bit 
rates, word size, start bits, stop bits, parity bit and the ability to operate at either 
5 TTL or RS-232 voltage levels. 

FIG. 4c shows the organization of a software-defined radio in accordance with an 
alternate embodiment of the invention. All of the elements of the software- 
defined radio 460 can be combined in any combination depending on the 

10 requirements. The elements include an RF scanner 462, a control link modem 
464, traffic modems 1 (466-1) through N (466-N), a location unit 468, and a 
wireless LAN device 470. The advantage of using a software-defined radio 
architecture is that ft allows implementation of multiple standards simultaneously 
on a single hardware device. This can greatly reduce the cost of the remote unit. 

is The underlying architectural concepts for the software-defined radio 460 are well 
known to those of ordinary skill in the art and are discussed in articles in 
numerous journals such as the IEEE Communications Magazine. 

FIG. 4d illustrates organization of the software in the remote unit in accordance 
20 with an embodiment of the invention. At the lowest level is the operating .system 
476 that provides basic functionality for the hardware platform. The remote unit 
can run a variety of operating systems such as Windows 95/NT/CE, Linux, Palm 
OS, VXWorks, QNX, or pSOS for example. Furthermore, depending on the 
requirements, it is possible to use no operating system and write platform-specific 
25 code to implement the lower level routines. 

At the next level, the remote unit software includes device drivers 478, utilities 
480, protocols, 482 and user interface modules 484. The device drivers 478 
allow communication with the peripheral devices such as the GPS receiver 404 
30 and the wireless modems, for example. The utilities 480 support lower-level 
functions such as encryption and compression, for example. The protocols 482 
support any protocols that are needed in the remote unit such as a WAP browser, 
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TCP/IP, X.25, and any proprietary packet protocols, for example. The user 
interface module 484 includes all of the functionality required for local control of 
the remote unit such as a simple menuing system. It is well known to those of 
ordinary skill in the art that some or all of these modules may also be built into the 
5 operating system. 

At the next level, the remote unit software optionally includes a variety of 
additional modules such as a pre-processing module 486, DB/Storage module 
488, and a software-defined radio module 490. The pre-processing module 486 

10 may be used to pre-process the collected data. This is particularly helpful in an 
operational scenario in which large quantities of data are collected and need to 
be reduced in order to conserve control link bandwidth. The DB/Storage module 
488 may be used to store and organize the requested missions and/or the 
collected data. The software-defined radio module 490 is implemented as 

is described above with reference to FIG. 4c. 

The main application 492 is at the next level and performs the higher-level 
routines. For example, the main application 492 is used to receive missions over 
the control link, execute the missions, and transmit the mission data over the 
20 control link. 

In the implementations described above, the control unit 302 is shown as being a 
general purpose computer in the form of a laptop or handheld unit 402. Although 
this has certain advantages in terms of flexibility of programming, the invention 
25 may also be implemented using special purpose computers in lieu of general 
purpose computers. 

Back End Processor 

30 FIG. 5a shows the architecture of the back end processor 500 in accordance with 
one embodiment of the invention. The back end processor 500 includes the 
following processing elements: fleet management 502, test traffic generator 504, 


27 


WO 01/72058 


PCT/US01/08999 


post processor 506, user interface 508, portal 510, mapping 512, and billing and 
accounting 514. These processing elements are interconnected by a data 
network 516. It is well known to those of ordinary skill in the art that the data 
network 516 can be either a LAN, WAN, inter processing communications within 
5 a computer or network, or any combination of the above. 

FIG. 5b shows the architecture of the back end processor 500 in accordance with 
a further embodiment of the invention. The back end processor includes the 
following processing elements: fleet management 530, test traffic generator 532, 

10 post processor 534, user interface 536, and portal 538 including a mapping 
element 538a and a billing and accounting element 538b. In addition, the fleet 
management element 530 is connected to a collected data database 540, 
mission database 542, and remote unit database 544; the post-processing 
element 534 is connected to a post-processed database 546 and the collected 

15 data database 540, and the portal 538 is connected to a mapping database 548 
and a billing and accounting database 550. 

The fleet management element 530 is the main interface in the back end 
processor for communicating with the remote units. The fleet management 

20 element keeps track of the remote units by accessing data in the remote unit 
database 544, performs mission planning and coordination based upon 
information provided from the user interface 536, sends and receives information 
to the test traffic generator 532 in order to generate terrestrial originated calls, 
and sends and receives commands and responses to the remote units via the 

25 control link. 

The fleet management element 530 receives mission requests from the user 
interface 536 and stores the information in the mission database 542. It then 
performs a scheduling function based on the requested missions stored in the 
30 mission database 542 as compared with the remote units available as 

determined by availability information stored in the remote unit database 544. 
The scheduled missions are stored in the mission database 542 as requested 
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missions and are sent at the appropriate time to the remote units over the control 
link. The requested missions can be stored and sent as a batch of missions or 
can be sent as individual missions depending on the requirements. 

5 The information received by the fleet management element 530 is stored in the 
collected data database 540 and forwarded to the post processor element 534 
that stores raw mission data and also performs post processing and stores the 
post processing results. 

10 The post processing involves processing of the received data for either 

RF/network parameters related to the wireless system or statistical information 
related to the wireless data access. 

The analysis of the RF/network parameters can be accomplished in a variety of 
is ways such as those discussed in Provisional Patent Application No. 60/149,888 
entitled 'Wireless Telephone Network Optimization" that was filed on August 19, 
1999, and which is incorporated by reference herein in its entirety for all 
purposes. This provisional disclosure provides a simulation environment to 
develop optimum coverage-related parameters for sectors of a wireless network. 
20 This simulation environment allows a network engineer to vary parameters of a 
virtual model of the wireless network and observe how the changes affect 
coverage. The provisional disclosure further provides an optimization algorithm 
to optimize hand off timing parameters for sectors in a wireless network. The 
optimization algorithm analyzes measured data regarding network coverage and 
25 regional terrain to arrive at a report containing recommended values for window 
size parameters (code division systems) or time advance parameters (time 
division systems). 

The post processing for statistical analysis involves the wireless data access that 
30 is accomplished using the traffic modem in the remote unit. The statistical 
analysis allows the combination of various collected information in order to 
produce reports for specific customers. For example, the latency of WAP 
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accesses to a specific URL is measured over several different wireless networks 
and displayed on a bar graph. Further examples of statistical analysis and report 
generation are discussed in the operation section with respect to FIGS. 8a-8f. 

5 The user interface element 536 is connected to the fleet management element 
530 in order to schedule missions based on requirements entered by the 
customers. Additionally, the user interface element 536 is connected to the post- 
processing element 534 to allow users to generate special queries, access 
previously stored queries, or access reports that are generated from the post 

10 processed data. The user interface element 536 is also connected to the portal 
538 to allow access for the customers 560 from a connected data network such 
as the Internet 562. 

The portal element 538 acts as an operating system providing a variety of low- 
15 level functions for multiple applications. The portal 538 includes a mapping 
element 538a and a billing and accounting element 538b. The portal 538 is 
connected to databases 548, 550 for the mapping information and the billing 
accounting information. In addition, the portal 538 is connected to the data 
network 562, such as the Internet, to allow customer entry into the system. The 
20 portal is also connected to the post processor 535 to allow access of the post- 
processed data for visualization with the mapping software, for example. 

FIG. 5c shows the architecture for the portal 570 in accordance with one 
embodiment of the invention. The portal 570 acts as an operating system 

25 providing common low-level functions for a variety of applications and acting as 
an interface for customer access through the Internet. The portal 570 functions 
are organized into four major groups: databases 572, GUI controls 574, 
workgroup functions 576, and security 578. The database 572 functions include 
terrain, morphology, buildings, and billing and accounting. The GUI controls 574 

30 include mapping/GIS, charts, and virtual reality. The workgroup functions 576 
include access controls and threaded dialogue. The security functions 578 
include login, partitioning, and audit trails. The portal also includes an API 580 
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that allows access to various applications. 
Control Link Communication Protocol 

5 The control link allows communications between the multiple remote units and 
the back end processor. There are a variety of possible protocols for the control 
link. The communication protocol can be a standard protocol such as TCP/IP, 
WAP, or X.25, for example, or a proprietary protocol that is optimized for the 
required communications, or some combination of a standard and proprietary 

10 protocol. 

In accordance with one embodiment of the invention, a proprietary packet 
protocol is used. One issue regarding the packet protocol is the issue of 
acknowledgments for packets. 

15 

Acknowledgments can be handled in a variety of ways. They can be sent as an 
individual packet for each substantive packet sent. This is the heartiest 
mechanism but it is bandwidth inefficient. Alternatively, acknowledgments can be 
sent as a field of a subsequent packet using a packet numbering scheme to 

20 indicate which previous packet is being acknowledged. This method requires 
more overhead at each end of the communication link in order to keep track of 
previously sent packets, but is more efficient in terms of bandwidth used. As 
another alternative, the acknowledgment system can be handled by the 
communication system itself so that the packet protocol does not have to address 

25 the issue. For example, many two-way data systems have a built-in 

acknowledgment system so that packet delivery is virtually guaranteed. In this 
case, it is not required to include acknowledgments in the packet protocol since 
they are handled at another level. 

30 There are two basic types of packets: signaling packets and data packets 

The signaling packets are originated either at the remote unit or at the back end 
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processor. Some examples of remote unit originated packets are ignition on, 
ignition off, and status update. The Ignition on packet indicates that the vehicle 
ignition has been turned on and the ignition off packet indicates that the vehicle 
ignition has been turned off. These packets are used by the back end processor 
5 in order to properly schedule data collection in a mobile remote unit. The status 
update packet indicates the current status of the remote unit. 

Some examples of back end originated packets are reset and status request. 
The reset packet is used to remotely reset the remote unit. The status request 
10 packet is used to remotely request status information for a remote unit. 

The data packets are also either originated at the remote unit or at the back end 
processor. The back end originated data packets generally consist of mission 
requests and the remote unit originated data packets generally consist of mission 
is data. 

FIG. 6a shows examples of some of the fields in the remote unit originated 
packets (both data and signaling) 610 in accordance with one embodiment of the 
invention. Some examples of the packet fields include a packet type ID 610a, 

20 remote unit ID 610b, date and time 610c, message number 61 Od, mission ID 
number 610e, location information 610f, payload information 610g, and 
checksum information 61 Oh. The packet type ID field 610a indicates the type of 
packet so that the back end processor will know how to parse the packet for the 
proper fields. The remote unit ID field 610b is used to identify the remote unit 

25 sending the packet. The date and time field 610c indicates the date and time 
that the measurement is taken. The message number field 61 Od is used to keep 
track of the message for acknowledgment purposes. The mission ID number 
field 61 Oe is used by data packets to indicate the corresponding back end 
mission that caused generation of the packef s payload information. The location 

30 information field 61 Of indicates the remote unit location at the time of data 

collection. The checksum information field 61 Oh is used in order to ensure the 
integrity of the packet information. The term checksum is used generically to 
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refer to any type of error correction and/or error detection method to ensure 
packet integrity. 

The remote unit originated data packet's payload information field 61 Og can take 
5 a variety of forms. It may include call statistics such as connect time, call 
duration, whether the call failed to connect or was dropped, and the like. 
Additionally, it may include basic RF engineering measurements such as RSSI, 
BER, FER, SQE, and the like. Furthermore, the payload information may include 
Layer 3 information that discloses call routing data and information regarding the 
10 configuration of the wireless network. The Layer 3 information may be collected 
in totality or filtered by pre-processing in the remote unit depending on the 
amount of information desired. In addition, the payload may include application 
information such as the access latency for a WAP page or the delay in receipt of 
an SMS message. 

15 

FIG. 6b shows examples of some of the fields in the back end processor 
originated packets (both data and signaling) 620 in accordance with one 
embodiment of the invention. Some examples of the packet fields include a 
packet type ID 620a, remote unit ID 620b, date and time 620c, message number 

20 620d, mission ID number 620e, payload information 620f, and checksum 

information 620g. The packet type ID field 620a indicates the type of packet so 
that the remote unit will know how to parse the packet for the proper fields. The 
remote unit ID field 620b is used to identify the remote unit receiving the packet. 
The date and time field 620c indicates the date and time that the packet is sent. 

25 The message number field 620d is used to keep track of the message for 

acknowledgment purposes. The mission ID number field 620e is used by data 
packets to indicate the back end mission that will cause generation of the 
packet's payload information. The checksum information field 620g is used in 
order to ensure the integrity of the packet information. The term checksum is 

30 used generically to refer to any type of error correction and/or error detection 
method to ensure packet integrity. 
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The back end processor originated data packets payload information field 620f 
can take a variety of forms. It may include mission info regarding the type of data 
to collect including the type of access (WAP, circuit switched data, etc), a trigger 
related to the time (or range of times) to make the test call, a trigger related to the 
5 location (or range of locations) to make the test call, a wireless system to test (if 
the remote unit supports multiple wireless traffic standards), a target phone 
number or URL, and whether the call is mobile or terrestrial originated. 

It should be noted that the packet field types described above are for illustrative 
10 purposes and in no way limit the actual fields that may be used. 

The information in the packet can be sent as either ASCII or binary data. ASCII 
is useful since some two-way data systems are used for paging and will only 
pass ASCII text information. Binary storage is useful because it is more 
is bandwidth efficient than ASCII. Furthermore, the packet information can be 
compressed by a variety of standard methods such as null compression, run- 
length compression, keyword encoding, adaptive Huffman coding, Lempel-Ziv 
coding, and the like. Additionally, the packet information can be encrypted by a 
variety of standard methods such as DES, triple DES, RSA, PGP, and the like. 

20 

In accordance with one embodiment of the invention, the packets are combined 
in larger files for transmission over the control link. This is advantageous in an 
environment in which the control network charges a fixed charge per packet. 
Accordingly, larger files may be more cost effective. Furthermore, it may be 

25 advantageous to store the collected information at the remote unit for 

transmission at a later time. This can occur if Layer 3 information is collected 
since the data may be collected faster than it can be sent over the control link. 
Additionally, the collected information may be stored at the remote unit if the 
vehicle ignition is turned off during a mission in a mobile environment. This 

30 occurs because the system tries to reduce transmissions when the ignition is off 
in order to extend battery life. 
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METHOD FOR MEASURING 

FIG. 7a shows a method for measuring data quality of service in a wireless 
network in accordance with one embodiment of the invention. The method 
5 includes the steps of sending command information 702, performing 
measurements 704, and receiving response information 706. 

For example, the step of sending command information 702 may include using a 
back end processor to send either data or signaling packets to the remote units of 

10 a measuring system such as the one described previously. Furthermore, the 
step of performing measurements 704 may include performing any of a variety of 
measurements such as latency of wireless Internet access, e-commerce 
transactions, wireless messaging, or push technologies. The step of receiving 
response information 706 may include responses to status inquiries or data 

is related to the measurements collected during the step of performing 
measurements 704. 

FIG. 7b shows a method for measuring data quality of service in a wireless 
network, including at least one step related to the wireless network infrastructure, 
20 in accordance with a further embodiment of the invention. The method includes 
the sending 702, performing 704, and receiving 706 steps described with respect 
to FIG. 7a. Additionally, the method includes steps of monitoring a WAP 
Gateway 710 and Benchmarking at a WAP Gateway 712. 

25 The step of monitoring the WAP Gateway 710 may include monitoring traffic 

through the WAP Gateway and providing metrics such as throughput, latency and 
lost packet information. Furthermore, the monitoring step 710 may allow the 
collection of protocol information directly from the WAP Gateway that may not be 
available to the multiple remote units. The step of benchmarking at the WAP 

30 Gateway 712 may allow latency measurements without including the 

uncertainties of the latency through the Internet or data network itself. This 
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allows the provision of data indicating a breakdown between the latency of the 
wireless network and the data network. 

It is important to note that in regard to steps 710 and 712 that the closeness to 
5 the WAP gateway is described from a logical, not a physical, standpoint. It will be 
appreciated by those of ordinary skill in the art that these process steps can be 
accomplished with well known techniques in which the monitoring or 
benchmarking element is located far away from the WAP gateway. Furthermore 
as previously discussed, the term WAP is being used generically to describe any 
10 type of wireless Internet protocol, including HDML, WAP competitors, and any 
future wireless Internet protocols that may be developed. 

FIG. 7c shows a method for measuring data quality of service in a wireless 
network, including at least one additional order independent step, in accordance 

15 with another embodiment of the invention. The method includes the sending 702, 
performing 704, and receiving 706 steps described with respect to FIG. 7a. 
Additionally, the method includes steps of accessing from the Internet 720, 
scheduling missions 722, generating test traffic 724, storing at a remote unit 726, 
pre-processing at a remote unit 728, post-processing at the back end 730, and 

20 organizing remote unit information 732. 

The step of accessing from the Internet 720 may include the ability to access the 
measuring system from the Internet through a portal to set up missions and 
retrieve reports generated from the post-processed data, for example. The step 

25 of scheduling missions 722 may include establishing parameters related to the 
specific data to be collected by the system. For example, these parameters may 
include some of the following: type of access - WAP, SMS, Instant Messaging, 
Push data, and the like.; type of Device - WAP, PDA, Pager, wireless modem, 
and the like.; trigger - time of call, location of remote unit, or some combination; 

30 wireless system - Sprint, Nextel, AT&T, and the like.; call Info - Target phone#, 
URL, type of transaction, etc; and mobile or terrestrial originated call. The step of 
generating test traffic 724 may include generation of SMS messages or other 
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data packets to be sent to the remote units, for example. 

The step of storing at the remote unit 726 may include the storing of missions and 
of collected data at the remote unit. The step of pre-processing at the remote 

5 unit 728 may include processing received data prior to storing the data or 

transmitting it to the back end processor. The step of post-processing at the back 
end 730 may involve processing of the received data for either RF/network 
parameters related to the wireless system or statistical information related to the 
wireless data access. The step of organizing remote unit information may include 

10 storage of remote unit identification information in a remote unit database, 
storage of collected data in a collected data database, or storage of post- 
processed data in a post-processed data database, for example. 

It should be noted that the flow arrows in FIGS. 7a-7c are shown merely for 
is illustrative purposes and do not reflect a required order for the method steps. 

OPERATIONAL AND BUSINESS MODEL 

The previous sections of this description have discussed a method and system 
20 for measuring data quality of service in a wireless network using multiple remote 
units and a back end processor. The method and system may also include an 
element that is located within the wireless network infrastructure, for example, at 
the WAP gateway to monitor the wireless data protocol and to perform 
benchmarking measurements. 

25 

In light of those previous sections, the following section discloses the operational 
and business model for the system in accordance with a further embodiment of 
the invention. 

30 Rather than selling measurement equipment as a final product, the system, as 
defined by the invention, preferably sells the collected data and statistics 
generated from the collected data as the final product. The trade name for this 
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service is preferably "Bitwise." The data and statistics generated by the system 
do not need to be real-time, but as previously disclosed the system will support 
near real-time data if desired. Typically, the data will be collected and analyzed 
over a period of time such as a day, week, month, or even a year depending on 
5 the user's requirements. 

The types of data collected include latency, call statistics (such as call 
completion, call dropped, etc), BER/FER, and various wireless network 
parameters such as RSSI and Layer 3 information. For example, the latency 
10 time is a measure of the access time for a WML page from a WAP server or the 
time to complete a Web transaction. Furthermore, the system can divide the 
latency measurement into the wired network and wireless network contribution 
through the use of a component located at the WAP gateway. 

is Furthermore, the remote units can be used to perform additional functions that 
have value in vertical markets. For example, if the remote units are fielded in a 
mobile environment in a fleet of vehicles, the remote units can provide automatic 
vehicle location (AVL) in addition to data quality of service measurements. 
Additionally, the position data from the mobile remote units could be processed to 

20 provide near real-time traffic information which could be disseminated, for 
example, over the Internet 

There are a variety of possible pricing strategies for the data and statistics 
produced by the system. The user may be charged per minute of system use or 
25 per transaction. Alternatively, the user may be charged per city, per wireless 

earner, and per month for the requisite data and statistics. Furthermore, the post- 
processing element produces aggregate industry-wide statistics, for example 
comparing different wireless carriers or content providers, which is preferably 
packaged and sold as a separate product. 

30 

The customers for the system have a variety of common attributes. They are 
dotcom and e-commerce companies that are targeting wireless device users by 
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porting their content and commerce to wireless web sites. Furthermore, they 
generally have a need for timely dissemination of content and transactions and 
have a keen interest in a positive customer experience. 

5 The customers can be divided into a variety of different groups. They can be 
wireless operators who wish to measure the performance of their networks in 
order to increase traffic and optimize performance. Furthermore, the customers 
can be wireless portals and/or ISPs such as AOL, Yahoo, Alta Vista, MSN, 
Lycos, and Excite, just to name a few examples. Additionally, the customers can 

10 be content providers in a variety of fields such as the service arena providing 
financial, weather, or traffic content; the internet auction arena involving time- 
sensitive bidding information; the instant messaging arena such as the AOL 
Anytime, Anywhere program; and the push data technology arena in which 
information such as airline information and traffic updates are pushed to the 

is mobile device. 

The reasons that customers would use the system, in accordance with an 
embodiment of the invention, are fairly straightforward. It allows the customer to 
see the wireless Internet transaction through the end user's eyes in terms of their 

20 experience when accessing content and conducting transactions from wireless 
devices. In addition, it allows the customers a method for evaluating and 
comparing the performance of the wireless networks that are delivering the 
content Furthermore, it allows the wireless operators and the content providers 
solid data to pinpoint bottlenecks and performance problems in the network. 

25 Additionally, it provides information to alert staff to critical service failures so 
corrective action can be taken in a timely manner. 

There are a variety of potential measurements that can be taken. Each 
measurement is referred to as a mission. Some examples of missions include 
30 retrieval of a WML page, completion of an e-commerce transaction, receiving 
pushed data content, performing a secure transaction, and performing 
benchmarking of different parts of the network by using a component located at 
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the WAP gateway. 

There are a variety of methods for inputting requested missions. If the customer 
wishes, they can discuss their requirements with the system operator and allow 
5 the system operator to enter the missions. Alternatively, a user interface in the 
back end processor allows the customers to enter their own missions over the 
Internet by entering through the portal. 

The parameters for a mission may include at least the following items: 
10 Type of access - WAP, SMS, Instant Messaging, Push data, and 

the like. 

Type of Device - WAP, PDA, Pager, wireless modem, and the like. 
Trigger - time of call, location of remote unit, or some combination 
Wireless System - Sprint, Nextel, AT&T, and the like, 
is Call Info - Target phone#, URL, type of transaction, etc 

Mobile or Terr. Originated. 

The output of the system can be obtained in a variety of ways. Generally, 
customers can set up formatted reports that will be generated periodically with 

20 the requested data and statistical information. The reports are obtainable in a 
variety of ways such as viewed using a Web browser, sent as an attachment to e- 
mail, sent as a file using FTP or some other protocol, or sent via normal mail just 
to name a few examples. The reports can be arranged in a variety of formats 
depending on the customer requirements with examples provided in the following 

25 figures. 

FIG. 8a shows a bar graph output 810 of download times from different portals, in 
accordance with an embodiment of the invention. The y-axis of the bar graph 
relates to the average download time in seconds and the x-axis relates to the city 
30 in which the measurement was performed. The three bars represent 

measurements for Yahoo, AOL, and a portal index of measurements over all 
portals. The statistics shown are for all wireless carriers, with a measurement 
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interval of 15 minutes between 6 AM and 12 PM, for the period from 03/01/00 to 
03/07/00. 

FIG. 8b shows a bar graph output 820 of download times across different 
5 wireless networks, in accordance with an embodiment of the invention. The y- 
axis of the bar graph relates to the average download time in seconds and the x- 
axis relates to the city in which the measurement was performed. The three bars 
represent measurements for Nextel, Sprint PCS, and AT&T Wireless. The 
statistics shown are for access to Yahoo, with a measurement interval of 30 
10 minutes between 6 AM and 9 PM, for the period from 03/01/00 to 03/07/00. 

FIG. 8c shows a bar graph output 830 of call completion percentage across 
different wireless networks, in accordance with an embodiment of the invention. 
The y-axis of the bar graph relates to the call completion percentage and the x- 
15 axis relates to the city in which the measurement was performed. The three bars 
represent measurements for Nextel, Sprint PCS, and AT&T Wireless. The 
statistics shown are for access to Yahoo, with a measurement interval of 30 
minutes between 6 AM and 9 PM, for the period from 03/01/00 to 03/07/00. 

20 FIG. 8d shows a trending graph output 840 of call completion percentage across 
different wireless networks, in accordance with an embodiment of the invention. 
The y-axis of the bar graph relates to the call completion percentage and the x- 
axis relates to the city in which the measurement was performed. The three bars 
represent measurements for Nextel, Sprint PCS, and AT&T Wireless. The 

25 statistics shown are for access to Yahoo, with a measurement interval of 15 
minutes between 6 AM and 9 PM, for the period from 03/01/00 to 03/07/00. 

FIG. 8e shows a bar graph output 850 of average download times with a 
breakdown of the network latency at the WAP gateway, in accordance with an 
30 embodiment of the invention. The y-axis of the bar graph relates to the average 
download time In seconds and the x-axis relates to the city in which the 
measurement was performed. The bars represent measurements for Nextel with 
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statistics shown for access to Yahoo, with a measurement interval of 60 minutes 
between 12 PM and 12 PM, for the period from 03/01/00 to 03/07/00. 

FIG. 8f shows a pie chart 860 of error statistics for wireless access of Yahoo, in 
5 accordance with an embodiment of the invention. The sectors of the pie chart 
show DNS lookup failure, connection timeout, page timeout, content errors, and 
successful error-free connections. The statistics represent error statistics for all 
carriers with statistics shown for access to Yahoo, with a measurement interval of 
60 minutes between 12 PM and 12 PM, for the period from 03/01/00 to 03/07/00. 

10 

The present invention has been described in accordance with a number of 
preferred embodiments. However, it will be understood by those of ordinary skill 
in the art that various modifications and improvements may be made to the 
invention as described, without departing from the scope of the invention. The 
15 scope of the invention is limited only by the appended claims. 
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We Claim: 


1 1 . A method for measuring data quality of service in a traffic wireless network 

2 comprising the steps of: 

3 sending command information related to data quality of service 

4 measurements; 

5 performing measurements to produce measurement information in 

6 relation to said command information; and 

7 receiving response information in relation to said measurement 

8 information and said command information. 
9 

1 2. The measuring method of claim 1 , wherein said sending step uses a 

2 wireless link. 

3 

1 3. The measuring method of claim 1 , wherein said sending step uses a 

2 CDPD link. 

3 

1 4. The measuring method of claim 1 , wherein said sending step uses a 

2 wireless LAN link. 

3 

1 5. The measuring method of claim 1 , wherein said sending step uses a wired 

2 link. 

3 

1 6. The measuring method of claim 1 , wherein said receiving step uses a 

2 wireless link. 

3 

1 7. The measuring method of claim 1 , wherein said receiving step uses a 

2 CDPD link. 

3 

1 8. The measuring method of claim 1, wherein said receiving step uses a 

2 wireless LAN link. 

3 
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1 9. The measuring method of claim 1, wherein said receiving step uses a 

2 wired link. 

3 

1 10. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to circuit switched data. 

3 

1 11. The measuring method of claim 1 , wherein said performing step produces 

2 measurement information related to packet data. 

3 

1 12. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to SMS messages. 

3 

1 13. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to wireless Internet access. 

3 

1 14. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to wireless Internet transactions. 

3 

1 15. The measuring method of claim 14, wherein wireless Internet transactions 

2 are e-commerce transactions. 

3 

1 16. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to push data. 

3 

1 17. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to latency. 

3 

1 18. The measuring method of claim 1, wherein said performing step produces 

2 measurement information includes Layer 3 network information. 

3 

l 19. The measuring method of claim 1, wherein said performing step produces 
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2 measurement information includes RF information. 

3 

1 20. The measuring method of claim 1, wherein said performing step produces 

2 measurement information includes call connection information. 

3 

1 21. The measuring method of claim 1, wherein said performing step 

2 produces measurement information related to iDEN. 

3 

1 22. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to CDMA. 

3 

1 23. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to TDMA. 

3 

1 24. The measuring method of claim 1, wherein said performing step produces 

2 measurement information related to AMPS. 

3 

1 25. The measuring method of claim 1 , comprising the further step of: 

2 monitoring WAP gateway functions. 

3 

1 26. The measuring method of claim 1 , comprising the further step of: 

2 benchmarking in relation to a WAP gateway. 

3 

1 27. The measuring method of claim 1, comprising the further step of: 

2 accessing a portal from the Internet for said command information 

3 and said measurement information. 

4 

1 28. The measuring method of claim 1, comprising the further step of: 

2 scheduling missions related to said command information. 

3 

l 29. The measuring method of claim 1 , comprising the further step of: 
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2 " generating test traffic related to said measurement information. 

3 

1 30. The measuring method of claim 1, comprising the further step of: 

2 storing said control information at a remote unit. 

3 

1 31 . The measuring method of claim 1, comprising the further step of: 

2 storing said measurement information at a remote unit. 

3 

1 32. The measuring method of claim 1, comprising the further step of: 

2 pre-processing said measurement information at a remote unit. 

3 

1 33. The measuring method of claim 1, comprising the further step of: 

2 post-processing said measurement information at a back end 

3 processor. 

4 

1 34. The measuring method of claim 1, comprising the further step of: 

2 organizing remote unit data, related to said command information, 

3 at a back end processor 

4 

1 35. The measuring method of claim 1, wherein said sending step includes 

2 sending said command information from a back end processor to at least 

3 one of a plurality of remote unit. 

4 

1 36. The measuring method of claim 1 , wherein said performing step includes 

2 performing said measurements using one of a plurality of remote units. 

3 

1 37. The measuring method of claim 1, wherein said receiving step includes 

2 receiving said response information at a back end processor from at least 

3 one of a plurality of remote units. 

4 

i 38. A measuring system for measuring data quality of service on at least one 
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2 traffic wireless network, comprising: 

3 a back end processor for controlling the measuring system; 

4 1 a plurality of remote units, in communication with said back end 

5 processor via a control link, for performing measurements on the at least 

6 one traffic wireless network. 

7 

1 39. The measuring system of claim 38, wherein said back end processor 

2 includes a fleet management element for managing said plurality of 

3 remote units. 

4 

1 40. The measuring system of claim 38, wherein said back end processor 

2 includes a test traffic generator for generating test traffic for said plurality 

3 of remote units. 

4 

1 41. The measuring system of claim 38, wherein said back end processor 

2 includes a post processor for post processing data collected from said 

3 plurality of remote units. 

4 

1 42. The measuring system of claim 38, wherein said back end processor 

2 includes a portal for allowing customer access through the Internet. 

3 

1 43. The measuring system of claim 42, wherein said portal includes a 

2 mapping element for combining mapping information with post processed 

3 data from said plurality of remote units. 

4 

1 44. The measuring system of claim 38, wherein each of said plurality of 

2 remote units includes a control unit for controlling said remote unit. 

3 

1 45. The measuring system of claim 44, wherein said control unit is a portable 

2 computer. 

3 
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1 46. The measuring system of claim 44, wherein said control unit is a single 

2 board computer. 

3 

1 47. The measuring system of claim 38, wherein each of said plurality of 

2 remote units includes a location unit for providing position information. 

3 

1 48. The measuring system of claim 47, wherein said location unit is a GPS 

2 receiver. 

3 

1 49. The measuring system of claim 38, wherein each of said plurality of 

2 remote units includes a control link modem for communicating via said 

3 control link with said back end processor. 

4 

1 50. The measuring system of claim 49, wherein said control link modem is a 

2 CDPD modem. 

3 

1 51. The measuring system of claim 49, wherein said control link modem is a 

2 software-defined radio modem. 

3 

1 52. The measuring system of claim 49, wherein said control link modem is a 

2 wired modem. 

3 

1 53. The measuring system of claim 49, wherein each of said plurality of 

2 remote units includes at least one traffic modem for performing said 

3 measurements on a respective traffic wireless network of the at least one 

4 traffic wireless network. 

5 • 

1 54. The measuring system of claim 53, wherein a respective traffic modem of 

2 said at least one traffic modem is said control link modem. 

3 

l 55. The measuring system of claim 53, wherein a respective traffic modem of 
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2 said at least one traffic modem is a modem module. 

3 

1 56. The measuring system of claim 53, wherein a respective traffic modem of 

2 said at least one traffic modem is a cellular phone. 

3 

1 57. The measuring system of claim 53, wherein a respective traffic modem of 

2 said at least one traffic modem is a software-defined radio. 

3 

1 58. The measuring system of claim 53, wherein a respective traffic modem of 

2 said at least one traffic modem is an iDEN modem. 

3 

1 59. The measuring system of claim 53, wherein a respective traffic modem of 

2 said at least one traffic modem is a CDMA modem. 

3 

1 60. The measuring system of claim 53, wherein a respective traffic modem of 

2 said at least one traffic modem is a TDMA modem. 

.3 

1 61 . The measuring system of claim 53, wherein a respective traffic modem of 

2 said at least one traffic modem is a GSM modem. 

3 

1 62. The measuring system of claim 38, wherein said measurements are 

2 performed on circuit switched data. 

3 

1 63. The measuring system of claim 38, wherein said measurements are 

2 performed on packet data. 

3 

1 64. The measuring system of claim 38, wherein said measurements are 

2 performed on SMS messages. 

3 

1 65. The measuring system of claim 38, wherein said measurements are 

2 performed on wireless Internet access. 
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3 

1 66. The measuring system of claim 38, wherein said measurements are 

2 performed on wireless Internet transactions. 

3 

1 67. The measuring system of claim 38, wherein said measurements are 

2 performed on wireless Internet e-commerce transactions. 

3 

1 68. The measuring system of claim 38, wherein said measurements are 

2 performed on push data. 

3 

1 69. The measuring system of claim 38, wherein said measurements include 

2 latency measurements. 

3 

1 70. The measuring system of claim 38, wherein said measurements include 

2 data reliability. 

3 

1 71. The measuring system of claim 38, wherein said measurements include 

2 Layer 3 network information. 

3 

1 72. The measuring system of claim 38, wherein said measurements include 

2 RF information. 

3 

1 73. The measuring system of claim 38, wherein said measurements include 

2 call connection information. 

3 

1 74. The measuring system of claim 38, wherein each of said plurality of 

2 remote units includes a plurality of traffic modems for performing said 

3 measurements on the at least one traffic wireless network. 

4 

1 75. The measuring system of claim 38, wherein each of said plurality of 

2 remote units includes a battery backup for providing backup battery 
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3 power. 

4 

1 76. The measuring system of claim 38, wherein each of said plurality of 

2 remote units includes an external storage for storing at least one of said 

3 measurements. 

4 

1 77. The measuring system of claim 38, wherein each of said plurality of 

2 remote units includes a wireless LAN device for communicating with said 

3 back end processor. 

4 

1 78. The measuring system of claim 38, wherein each of said plurality of 

2 remote units includes an RF scanner for measuring the at least one traffic 

3 wireless network. 

4 

1 79. The measuring system of claim 78, wherein said RF scanner is a 

2 software-defined radio. 

3 

1 80. The measuring system of claim 38, further comprising: 

2 a WAP monitor for monitoring WAP gateway functions. 

3 

1 81. The measuring system of claim 38, further comprising: 

2 a WAP benchmarker for benchmarking in relation to a WAP 

3 gateway. 

4 

1 82. The measuring system of claim 38, wherein at least one of said plurality 

2 of remote units is stationary. 

3 

1 83. The measuring system of claim 38, wherein at least one of said plurality 

2 of remote units is mobile. 

3 

i 84. The measuring system of claim 38, wherein all of said plurality of remote 
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2 units, within a geographic area, are stationary. 

3 

l 85. The measuring system of claim 38, wherein said control link is wired. 

2 

i 86. The measuring system of claim 38, wherein said control link is wireless. 

2 

1 87. The measuring system of claim 38, wherein said control fink is wired and 

2 wireless. 

3 

1 88. The measuring system of claim 38, wherein said control link uses a 

2 wireless standard in relation to a geographic area of the associated 

3 remote units. 

4 

1 89. A remote unit, which is one of a plurality of remote units that 

2 communicates with a back end processor, for measuring data quality of 

3 service on at least one traffic wireless network, comprising: 

4 a control unit for controlling said remote unit; 

5 a location unit for providing position information; 

6 a control link modem for communicating via a control link with the 

7 back end processor; and 

8 at least one traffic modem for performing measurements on a 

9 respective traffic wireless network of the at least one traffic wireless 
10 network. 

n 

1 90. The remote unit of claim 89, wherein said control unit is a portable 

2 computer. 

3 

1 91 The remote unit of claim 89, wherein said control unit is a single board 

2 computer. 

3 

i 92. The remote unit of claim 89, wherein said location unit is. a GPS receiver. 
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2 

1 93. The remote unit of claim 89, wherein said control link modem is a CDPD 

2 modem. 

3 

1 94. The remote unit of claim 89, wherein said control link modem is a 

2 software-defined radio modem. 

3 

1 95. The remote unit of claim 89, wherein said control link modem is a wired 

2 modem. 

3 

1 96. The remote unit of claim 89, wherein each traffic modem of said at least 

2 one traffic modem performs measurements on a respective traffic wireless 

3 network of the at least one traffic wireless network. 

4 

1 97. The remote unit of claim 89, wherein a respective traffic modem of said at 

2 least one traffic modem is said control link modem. 

3 

1 98. The remote unit of claim 89, wherein a respective traffic modem of said at 

2 least one traffic modem is a modem module. 

3 

1 99. The remote unit of claim 89, wherein a respective traffic modem of said at 

2 least one traffic modem is a cellular phone. 

3 

1 100. The remote unit of claim 89, wherein a respective traffic modem of 

2 said at least one traffic modem is a software-defined radio. 

3 

1 101. The remote unit of claim 89, wherein a respective traffic modem of 

2 said at least one traffic modem is an iDEN modem. 

3 

1 102. The remote unit of claim 89, wherein a respective traffic modem of 

2 said at least one traffic modem is a CDMA modem. 
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103. The remote unit of claim 89, wherein a respective traffic modem of 
said at least one traffic modem is a TDMA modem. 

104. The remote unit of claim 89 t wherein a respective traffic modem of 
said at least one traffic modem is a GSM modem. 

105. The remote unit of claim 89, wherein said measurements are 
performed on circuit switched data. 

106. The remote unit of claim 89, wherein said measurements are 
performed on packet data. 

107. The remote unit of claim 89, wherein said measurements are 
performed on SMS messages. 

108. The remote unit of claim 89, wherein said measurements are 
performed on wireless Internet access. 

109. The remote unit of claim 89, wherein said measurements are 
performed on wireless Internet transactions. 

110. The remote unit of claim 89, wherein said measurements are 
performed on wireless Internet e-commerce transactions. 

111. The remote unit of claim 89, wherein said measurements are 
performed on push data. 

112. The remote unit of claim 89, wherein said measurements include 
latency measurements. 
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1 113. The remote unit of claim 89, wherein said measurements include 

2 data reliability. 

3 

1 114. The remote unit of claim 89, wherein said measurements include 

2 Layer 3 network information. 

3 

1 115. The remote unit of claim 89, wherein said measurements include 

2 RF information. 

3 

1 116. The remote unit of claim 89, wherein said measurements include 

2 call connection information. 

3 

1 117. The remote unit of claim 89, wherein each of said plurality of 

2 remote units includes a battery backup for providing backup battery 

3 power. 

4 

1 118. The remote unit of claim 89, further comprising: 

2 an external storage for storing at least one of said measurements. 

3 

1 119. The remote unit of claim 89, further comprising: 

2 a wireless LAN device for communicating with the back end 

3 processor. 

4 

1 120. The remote unit of claim 89, further comprising: 

2 an RF scanner for measuring the at least one traffic wireless 

3 network. 

4 

1 121 . The remote unit of claim 120, wherein said RF scanner is a 

2 software-defined radio. 

3 

i 122. The remote unit of claim 89, wherein said remote unit is stationary. 
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2 


i 123. The remote unit of claim 89, wherein said remote unit is mobile. 

2 

i 124. The remote unit of claim 89, wherein said control link is wired. 

2 

i 125. The remote unit of claim 89, wherein said control link is wireless. 

2 

1 126. The remote unit of claim 89, wherein said control link uses a 

2 wireless standard in relation to a geographic area of the associated 

3 remote unit. 

4 

1 127. A method for measuring data quality of service in a traffic wireless 

2 network using a back end processor and plural remote units, the method 

3 comprising: 

4 sending command information from the back end processor to at 

5 least two of the plural remote units, the command information being 

6 related to data quality of service measurements; 

7 performing measurements on the traffic wireless network, using the 

8 at least two of the plural remote units, to produce measurement 

9 information in relation to said command information; and 

io receiving response information at the back end processor from the 

n at least two of the plural remote units, said response information being in 

12 relation to said measurement information and said command information; 

13 wherein said response information provides a measure of data 

14 quality of service in the traffic wireless network. 

15 

1 128. A method for measuring data quality of service in a traffic wireless 

2 network, the method comprising: 

3 receiving command information related to data quality of service 

4 measurements sent from a back end processor; 

5 performing one or more measurements of performance in the traffic 
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6 wireless network to produce measurement information in relation to said 

7 command information; and 

8 sending response information in relation to said measurement 

9 information and said command information to the back end processor. 

10 

1 129. A method for producing a measurement result that is indicative of 

2 data quality of service in a traffic wireless network, the method comprising: 

3 sending command information to plural remote units, said 

4 command information being related to data quality of service 

5 measurements; 

6 receiving response information from the plural remote units, said 

7 response information being in relation to said command information and 

8 measurements performed on the traffic wireless network via the plural 

9 remote units; and 

10 generating a measurement result based on said response 
n information. 

12 

1 130. A system for assessing data quality of service on a wireless network, 

2 the system comprising: 

3 means for obtaining measurements, at a statistically significant number of 

4 locations, of a performance parameter on the wireless network; and 

5 means for consolidating information indicative of the measurements 

6 obtained by the means for obtaining; 

7 wherein the information consolidated by the means for consolidating 

8 provides an assessment of data quality of service on the wireless network. 

9 

1 1 31 . The system of claim 130, wherein the means for obtaining 

2 measurements comprises plural remote units. 

3 

1 132. The system of claim 131, wherein a portion of the plural remote units 

2 are mobile units. 
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133. The system of claim 131, wherein substantially all of the plural 
measurement units are mobile units. 

134. The system of claim 131, wherein substantially all of the plural 
measurement units are stationary units. 

135. The system of claim 130, wherein the means for consolidating 
comprises a back end processor. 

136. The system of claim 130, wherein the means for obtaining 
measurements performs the function of obtaining measurements in response to 
command information received from the means for consolidating. 

137. A device for obtaining measurements indicative of data quality of 
service for a wireless network providing data service, the device comprising: 

a control link modem providing communications with a back end 
processor; 

a traffic modem providing communications via the wireless network; 
a location unit providing position information; and 
a computer, the computer comprising: 

a processor in communication with the control link modem and 
the traffic modem, and being connected to the location unit, and 
a memory, connected to the processor, bearing software 
instructions adapted to enable the computer to perform the steps of: 
receiving command information from the back end processor; 
sending test traffic over the wireless network based on the 
command information received from the back end 
processor; 

receiving response traffic over the wireless network in reply to 
the test traffic; 
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18 recording measurement information comprising information 

19 regarding the test traffic, the response traffic, and 

20 location information contemporaneous with the step of 

21 receiving response traffic; and 

22 sending the recorded measurement information to the back end 

23 processor. 

24 

1 1 38. A device for obtaining measurements indicative of data quality of 

2 service for a wireless network providing data service, the device comprising: 

3 a control link modem providing communications with a back end 

4 processor; 

5 a traffic modem providing communications via the wireless network; 

6 a location unit providing position information; and 

7 a computer, the computer comprising: 

8 a processor in communication with the control link modem and 

9 the traffic modem, and being connected to the location unit, and 

10 a memory, connected to the processor, bearing software 

11 instructions adapted to enable the computer to perform the steps of: 

12 receiving command information from the back end processor; 

13 receiving test traffic over the wireless network; 

u recording measurement information comprising information 

15 regarding the test traffic and location information 

16 contemporaneous with the step of receiving test traffic; 

17 and 

18 sending the recorded measurement information to the back end 

19 processor. 

20 

1 139. A device for obtaining measurements indicative of data quality of 

2 service for a wireless network providing data service, the device comprising: 

3 a modem providing communications with a back end processor and 

4 providing communications via the wireless network; 
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5 a location unit providing position information; and 

6 a computer, the computer comprising: 

7 a processor in communication with the modem and being 

8 connected to the location unit, and 

9 a memory, connected to the processor, bearing software 

10 instructions adapted to enable the computer to perform the steps of: 

11 receiving command information from the back end processor; 

12 sending test traffic over the wireless network based on the 

13 command information received from the back end 

14 processor; 

15 receiving response traffic over the wireless network in reply to 

16 the test traffic; 

n recording measurement information comprising information 

is regarding the test traffic, the response traffic, and 

19 location information contemporaneous with the step of 

20 receiving response traffic; and 

21 sending the recorded measurement information to the back end 

22 processor. 

23 

1 140. A device for obtaining measurements indicative of data quality of 

2 service for a wireless network providing data service, the device comprising: 

3 a modem providing communications with a back end processor and 

4 providing communications via the wireless network; 

5 a location unit providing position information; and 

6 a computer, the computer comprising: 

7 a processor in communication with the modem and being 

8 connected to the location unit, and 

9 a memory, connected to the processor, bearing software 

10 instructions adapted to enable the computer to perform the steps of: 

11 receiving command information from the back end processor; 

12 receiving test traffic over the wireless network; 
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13 recording measurement information comprising information 

14 regarding the test traffic and location information 

15 contemporaneous with the step of receiving test traffic; 

16 and 

17 sending the recorded measurement information to the back end 

18 processor. 

19 

1 141. A method of conducting commerce, the method comprising: 

2 performing measurements on a wireless network, the measurements 

3 being indicative of data quality of service for the wireless network; 

4 consolidating the performed measurements at a back end processor to 

5 form data quality of service information; and 

6 providing the data quality of service information to a customer in exchange 

7 for value. 

8 

1 142. The method of conducting commerce of claim 141 , further 

2 comprising: 

3 receiving a mission request from the customer, wherein the 

4 measurements are performed in response to the mission request. 

5 

1 143. The method of conducting commerce of claim 141, wherein the 

2 customer is a content provider. 
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